Cosmological test of gravity with polarizations of stochastic gravitational waves 

around 0.1-1 Hz 
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In general relativity, a gravitational wave has two polarization modes (tensor mode), but it could 
have additional polarizations (scalar and vector modes) in the early stage of the universe, where 
the general relativity may not strictly hold and/or the effect of higher-dimensional gravity may 
become significant. In this paper, we discuss how to detect extra-polarization modes of stochastic 
gravitational wave background (GWB), and study the separability of each polarization using future 
space-based detectors such as BBO and DECIGO. We specifically consider two plausible setups of 
the spacecraft constellations consisting of two and four clusters, and estimate the sensitivity to each 
polarization mode of GWBs. We find that a separate detection of each polarization mode is rather 
sensitive to the geometric configuration and distance between clusters and that the clusters should 
be, in general, separated by an appropriate distance. This seriously degrades the signal sensitivity, 
however, for suitable conditions, space-based detector can separately detect scalar, vector and tensor 



modes of GWBs with energy density as low as h Q, g ^ 
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PACS numbers: 04.50. Kd, 04.80. Cc, 04.80. Nn. 



I. INTRODUCTION 

Incoherent superposition of gravitational waves pro- 
duced by many unresolved sources or diffuse sources 
forms a stochastic background of gravitational waves 
(GWs), whose statistical properties contain valuable in- 
formation about the high-energy astrophysical phenom- 
ena and the cosmic structure formation. In particu- 
lar, with the gravitational wave backgrounds (GWBs), 
we can directly probe the very early Universe beyond 
the last-scattering surface of the cosmic microwave back- 
ground. 

Various mechanisms or scenarios have been proposed 
for generation of cosmological GWBs in the early uni- 
verse, via the inflation Q-Q, cosmological pha se transi- 
tion p-Q' an d reheating of the Universe [9l-Fl3j and etc.. 
An important aspect of those scenarios is that general 
relativity (GR) may not strictly hold in the high-energy 
regime of the universe, and the gravitational waves do 
not necessarily satisfy the transverse and traceless con- 
ditions. This implies that the number of polarization 
modes of a GW is more than that of tensor modes (i.e., 
two polarization modes called plus and cross modes) , and 
it can have six modes at most in the four-dimensional 
spacetime, including scalar and vector modes [l4| Il5j . 
In modified gravity theories such as Brans-Dickc theory 
[H [13 and f(R) gravity pj, El], such additional po- 
larizations appear (For more rigorous treatment of the 
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polarizations with the Newman-Penrose formalism, see 
pfl l2lj]). Further, there are several attractive scenar- 
ios that we live in a three-dimensional brane embedded 
in a higher-dimensional spacetime, such as the Kaluza- 
Klein theory and the Dvali-Gabadadze-Porrati (DGP) 
braneworld model [22]. In those models, even the ten- 
sor modes satisfying the transverse and traceless condi- 
tions can have extra polarization degrees, which propa- 
gate in the extra-dimensional bulk spacetime. The effects 
of higher-dimensional gravity are expected to be signif- 
icant at high-energy scales, and thus the cosmological 
GWBs generated during such a stage may have additional 
polarization modes, which can be viewed as the mixture 
of scalar and vector polarizations in the projected three- 
dimensional space. In these respects, the polarization 
modes of GWBs provide additional information about 
the physics of the early universe, and thus a search for 
extra-polarization modes is indispensable as a cosmolog- 
ical test of GR. Note also that the polarization of GWB 
from astrophysical origin can also be useful as a test of 
strong gravity associated with astrophysical phenomena. 

Currently, there is no observational evidence for 
GWBs, and the constraints on the extra-polarization 
modes of GWBs are almost nonexistent |66[. How- 
ever, the observations of cosmic microwave background 
anisotropies are currently consistent with the adiabatic 
density perturbations plus negligible contribution of ten- 
sor GWB [23[ and no significant contributions of scalar 
and vector GWBs are expected. Further, a search for 
stochastic GWBs by LIGO [24[ has given an upper 
limit on the energy density of GWBs around ~ 100Hz, 
/i 2 O gw < 3.6 x KT 6 , where Q gw is the energy density per 
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logarithmic frequency bin normalized by the critical den- 
sity of the Universe, and the present Hubble parameter 
normalized by Ha = 100 /io km sec -1 Mpc -1 . This null 
detection is applied to the constraints on the GWBs of 
extra-polarization modes with correction by a factor of a 
few, depending on the response of the GW detectors to 
each polarization mode. 

In this paper, we investigate how well we can sepa- 
rately detect and measure the polarizations of a GWB us- 
ing space-based GW detectors. Previously, we have stud- 
ied the detection and separation of polarization modes of 
GWB using a network of ground-based laser interferom- 
eters (for a detection of GWB using the pulsar timing 
arrays, see Ref. [25]). With the correlation signals 
obtained from more than three advanced detectors, we 
found that scalar, vector and tensor modes of GWBs can 
be separately detected around the frequencies / ~ 100Hz, 
and the sensitivity to each polarization mode can reach 
/igfigw = 10 -9 ~ 10 -8 . Extending the previous anal- 
ysis to those using space-based interferometers, we dis- 
cuss a direct detection of extra-polarization modes of low- 
frequency GWBs at / = 0.1 - 1Hz. 

Currently, several space missions to detect GWs have 
been proposed. Among these, DECI-hertz interferometer 
Gravitational-wave Observatory (DECIGO) [2(1 and 
Big-Bang Observer (BBO) [28| (also see [29j for updated 
information) will aim at detecting cosmological GWBs 
generated during the inflationary epoch as the primary 
target. These orbit the Sun with a period of one side- 
real year, and constitute several clusters, each of which 
consists of three spacecrafts exchanging laser beams with 
the others, as shown in Fig. [TJ DECIGO plans to have 
the arm-length 10 3 km, equipped with Fabry-Perot cav- 
ity in each arm, while BBO will adopt the transponder 
type with arm-length 10 4 km. The crucial difference be- 
tween space- and ground-based detectors is that prac- 
tical design as well as precise orbital configurations for 
space interferometers are still under debate, and there 
are a number of options for the detector configuration. 
Hence, in this paper, we will examine several plausible 
setups and discuss under what conditions we can sepa- 
rately measure the scalar, vector and tensor polarizations 
of GWB. 

This paper is organized as follows. In Sec. [Hi for nota- 
tional convenience, we first present the definitions of GW 
polarizations. Then, we discuss a methodology to sepa- 
rately detect the polarization modes, based on the previ- 
ous analysis using the ground-based interferometers. In 
Sec. lIIIi we investigate the separability of the polarization 
modes of the GWB in specific configurations of space- 
based detectors, and calculate the detector sensitivities to 
each polarization mode, especially focusing on DECIGO. 
Sec. [TV] presents discussion on the low- frequency cutoff 
due to the presence of astronomical confusion noise, and 
the sensitivity to polarizations in the BBO case. Finally, 
the paper is summarized in Sec. [V] 




FIG. 1: A cluster of DECIGO. 



II. FORMULATION 

A. GW polarizations and detector response 

We start by briefly reviewing the basic concepts of data 
analysis of stochastic GWB search. First consider the 
spacetime metric generated by a stochastic GWB in the 
observed three-dimensional space. At a position X and 
time t, it is expressed as 

h(*,X) = J2j s2 d & J" df 

x^(/,n)e 2 ^*-"'*/ c )e p (n), (1) 

where c is the speed of light [3(|, / is frequency of a 
GW, and tl is a unit vector pointed at the GW propa- 
gating direction. The amplitude h p (f,fl) represents the 
Fourier transform of the GW amplitude for each polariza- 
tion mode, and the quantity e p is the polarization ten- 
sor. Including the extra-polarization degrees of scalar 
and vector modes, we have six polarization modes in 
three-dimensional space; p — +, x,6, £, x, and y, which 
are called plus, cross, breathing, longitudinal, vector-x, 
and vector-y modes, respectively. Using the orthonormal 
vectors, rh and n, perpendicular to the direction vector SI 
(as shown in Fig. [2J, the polarization tensors are defined 

by HHH 

e + = rh <g> m — n ® n , 

e x = m<g>n + n®rh, 

eb = rh ® rh + n <g) n , 

e e = VSn ® tl , 

e x = m Cg) ft + ft (g> m , 

e y = n ® O + O ® n . 

Each polarization mode is orthogonal to one another and 
is normalized so that e^-e^, = 2S pp i for p,p' = +, X, b,£, x, 
and y. Note that the breathing and longitudinal modes 
do not satisfy the traceless condition, in contrast to the 
ordinary plus and cross polarization modes in GR. For 
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FIG. 2: Coordinate systems. 



the universe with extra-dimensions, the number of polar- 
ization modes generally can be more than six, but in the 
projected three-dimensional space, GW can be viewed as 
a mixture of scalar, vector and tensor modes mentioned 
above. 

Next consider the response of the GW detector. The 
laser interferometers measure the time variation of the 
spacetime metric as one-dimensional time-series data. In 
a space-based interferometer, the gravitational- wave sig- 
nal is obtained by differentiating two link signals in Figfl] 
(three interferometer signals is obtained about a cluster.). 
Denoting the signal strain measured by the interferome- 
ter / (whose position is located at X) by hj(t), the strain 
amplitude of GW is expressed as 



hi(t,X) 



D/ : h(t,X 

E 



df 



xhpif^e^-n^Ffif,^) , (2) 

where the quantity D/ is the detector tensor, and the 
Fj is the angular response function for each polarization 
mode. They are respectively given by 



Ff(fl) = D/ : e p (n) 



D/ = — [u ® u — v (8 v] 



(3) 
(4) 



with the unit vectors u and v being directed to each 
detector arm. The expression of Eq. Q is valid when 
the arm length of the detector, L, is much smaller than 
the wavelength of observed GWs, A g , i.e., L <C A g . For 
DECIGO, the observable frequency range is around / ~ 
1 Hz, which corresponds to A g = 3 x 10 5 km. Thus, with 
the arm length L — 10 3 km, the so-called low frequency 
approximation is fully satisfied. 



B. Cross-correlation analysis 

Throughout the paper, we assume that stochastic 
GWB is (i) isotropic, (ii) stationary, (iii) Gaussian, and 
(iv) has no intrinsic correlation between polarization 
modes (If this is not the case, see (3lT[37j and [38M40j 
for discussions on the detection of GWBs in the pres- 
ence of anisotropics and non-Gaussianity, respectively.). 
Adopting these assumptions, all the statistical proper- 
ties of the GWB are characterized by the power spectral 
density: 

1 



(h* p (f,n)h p . (/',«')> = s(f - f)—s 2 (n,n>)5 pp , 



(•5) 



where 5 2 (f2,l!') = 5((j> - cj>' ) 5 (cos d - cos 9'), and (• • ■ ) 
denotes ensemble average. The function S?(f) is the one- 
sided power spectral density for each polarization mode. 

Conventionally, the amplitude of GWB for each po- 
larization is also characterized by an energy density per 
logarithmic frequency bin, normalized by the critical en- 
ergy density of the Universe: 



n?w(/) 



1 dpP /2tt 2 



Pcdlnf V.3#o 



fSKf) , (6) 



where p c — 3Hq/8ttG and Ho is the Hubble constant. In 
the second equality, we used the relation between f2 gw (/) 
and S h (f) given by HHEsj. Then, we define the GWB 
energy density in tensor, vector, and scalar polarization 
modes as 
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The subscripts T, V, and S stand for tensor, vector, and 
scalar, respectively. Hereafter, we assume f2+, = 



for the tensor mode and ffljL, 

gw 



we assume f2j_, - 

gw gw 

fty for the vector mode. 

gw 



This assumption is valid for a stochastic GWB generated 
in most of cosmological scenarios [43|. For the scalar 
mode, we introduce a model-dependent new parameter, 
«(/) = ^ w (/)/^ w (/). 

In order to discriminate a stochastic GWB from ran- 
dom detector noise, one needs to cross-correlate between 
detector signals (42|, 0, EE] ■ Let us consider the outputs 
of a detector, s(t) = h(t) + n(t), where h(t) and n{t) are 
the GW signal and the noise of a detector. In general, 
the amplitude of GWB is thought to be much smaller 
than that of detector noise. Cross-correlation signal Y 
between two detectors is given by 

/Tobs/2 rT aba /2 
dt / dt' si(t)sj(t')Q(t-t') , 

-T obs /2 J-T obB /2 

/oo 
df'S T (f - f)sKf)Sj(f')Q(n(7) 
-oo 
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where T t, s is observation time, sj(/), §j(f) and Q(f) are 
the Fourier transforms of sj(i), s,/(t) and Q(£ — t'), re- 
spectively. Q(t — t') is a filter function, which will be later 
adjusted to maximize the signal-to-noise ratio (SNR) of 
correlation signal. The function #t(/) is defined by 

J-T ohe /2 17 

Taking the ensemble average over the expression (|7|), 
and substituting Eqs. §5$ and © into this, we obtain 
a GW signal in a correlation analysis between 7-th and 
J-th detectors, 



# / dfS T (f - fm{f)hj{f))Q{f) . 



' W |r obs sin 2 X / df\f\- 3 Q(f) 



20tt 2 

^w(/)7/ T /(/) + ^;(/)7X;(/) 
+e(/)^ S w(/)7fj(/) 



(8) 



The parameter £ takes the value in the range 1/3 < £ < 
2/3 and characterizes the ratio of the energy in the longi- 
tudinal mode to the breathing mode. The sensitivity to 
the GWB can be g overned by the so-called overlap reduc- 
tion functions [U H, EH , which represents how much of 
the correlation of the GW signal between detectors can 
be preserved. The overlap reduction function for each 
polarization is defined by [46| 



1 



2mffl-AX/c>r>M 



sm" x J S 2 4tt 



(9) 



(FfFj 
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1 + 2k 



(FjFj + kFjFj) 



which are normalized to unity in the limit / — > 0. The 
subscript M denotes M — T,V,S, and the quantity AX 
is the separation vector defined by AX = Xj — Xj. Note 
that the prefactor, sin 2 x = 1 — (u • v) 2 , in Eq. © comes 
from the non-orthogonal detector arms. For an equilat- 
eral triangle configuration of the spacecraft constellation 
in Fig. [I] we have sin 2 x = 3/4. 

In Eq. ©, the angular integral is analytically per- 
formed prior to specifying the detector location and ori- 



entation [46|. The result is expressed as 
1 



sin 2 x 



pf {a)D^D( 3 + pf (a)Dl k Dj d t d 3 



+pf{a)D t j >D k fd l d J d k d, 



(10) 



with unit vector di defined by d\ = AX/|AX|. The 
summation is taken over each component of the sub- 
scripts i,j,k,£. In the above, frequency dependence of 
the overlap reduction function is incorporated into the 
coefficients, pf 1 , p^f , and p^ 1 , which sensitively depend 
on each polarization mode. We have 

28 -40 2 
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for vector mode, and 
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for scalar mode. Here, j n {ct) is the spherical Besscl func- 
tion with its argument given by 



«(/) 



2-KfD 



D = IAXI 



(11) 



These expressions are very useful to obtain a simple ex- 
pression for the overlap reduction function in specific de- 
tector configurations below. 

Let us now consider the noise part in the cross corre- 
lation analysis. As long as the intrinsic noise correlation 
between two detectors is absent, the ensemble average 
of cross correlation quantity Y in Eq. ([7]) is dominated 
by the GW signals. This is true even in the weak signal 
limit, h <C n. However, the variance of Y is dominated 
by the detector noises. We obtain 



(Y 2 ) 
(Y 2 ) 



(Yf 



df 



df'Q(f)Q*(f) 



x<nJ(/)fij(/')><M/)»j(/')> 

' #Pz(|/|)Pj(|/|)|Q(/)| 2 , (12) 

where the one-sided power spectrum density of the de- 
tector noise, Pi(f), is defined by 

(hKf^jin^l-sif-nsjjPjdfi). 
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FIG. 3: DECIGO noise curve. 



For DECIGO, the analytical fit of the noise power spec- 
trum is obtained for a single interferometer. Assuming 
that the detector noise is idealistically limited by the sum 
of quantum noises, i.e., shot noise, p shot ; and radiation- 
pressure (acceleration) noise, P 3 ^, we have 

P(f) = P a -(/) + P shot (/) 

-4 



P acc (/) = 6.31 x 1(T 51 ( -4r 



Hz" 



P shot (f) = 1. 



x 10" 



x 10 
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J_ 

1Hz 
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In Fig. |3l the noise power spectrum of DECIGO is plotted 
as the strain amplitude, S^/ 2 . 

From Eqs. ® and (fl2|). the SNR in the correla- 
tion analysis between two detectors is simply given by 
SNR = \il a. In the absence of extra-polarization degrees 
(i.e., only the tensor modes exit), two-detector correla- 
tion is sufficient to detect GWB, and the optimal choice 
of the filter function Q(f) is easy to derive (42J. On 
the other hand, in the presence of multiple polarization 
modes, we need more than three detectors in order to 
separately detect each polarization mode. The optimal 
SNR combining multiple detectors is not simply given by 
the sum of fi/cr, and thus the choice of filter function is 
rather non-trivial. We will discuss this issue in the next 
section. 



C. Signal-to-noise ratio 

In principle, three polarization modes, i.e., scalar, vec- 
tor and tensor, can be separately detected by linearly 
combining more than three independent correlation sig- 
nals. In our previous paper (46[, we considered the situa- 
tion that only the three correlation signals are available. 
We then presented the formula for optimal SNR. Here, 
we consider the optimal SNR combining arbitrarily large 
number, N pa x T , of correlation signals. Such a generalized 
formula has been derived for the cases with two polariza- 
tions (i.e., circularly polarized and un-polarized modes of 



tensor GWs) by Seto and Taruya (48|. Based on this, in 
Appendix [Bj the extension of the formula to the three- 
polarization case is presented. Combining N pa si corre- 
lation signals, the resultant optimal SNR for separately 
detecting scalar, vector and tensor GWBs becomes (see 
Eq. JEOfl) 



SNR M = 9H ° 



40tt 2 



df 



(fi£(/)) 2 detF(/) 



"I 1/2 



/ 6 ^m(/) 



(13) 



P(/) = 



Ftt Ftv Fts 
Ftv Fvv Fys 
Fts Fys Pss 



F 



MAI 



(/) 



E 



dt 



1? (tJ)lf (*,/) 

M(/) 



(14) 



where M and M' denote polarization modes, M, M' = 
T,V,S. The quantity J~m is the determinant of the sub- 
matrix, which is constructed by removing the M's ele- 
ments from F. The subscript i indicates a pair of detec- 
tors (e.g., i = (I, J) for pair of I- and J-th detectors), 
and Afi(f) is defined as, say, N 12 {f) = Pi(/)P 2 (/). In 
what follows, for simplicity, we consider the case that 
all interferometers have the same noise spectrum, i.e., 

The expression (|13p is a rather general formula for op- 
timal SNR in the sense that the stationary configuration 
of GW detectors is not strictly assumed. The configu- 
ration of space-based interferometers gradually changes 
in time due to the orbital motion of the spacecrafts. In 
the formula (fT3|) . the effect of such gradual change is in- 
corporated into the explicit time dependence of the over- 
lap reduction function, which will be important later in 
Sec. IIII B[ Note that for stationary detector configura- 
tion, the time integral in Eq. (|14[) simply reduces to the 
factor T b s , which gives rise to the well-known result that 

1 12 

SNR oc T Q 4 . Further, if we consider the combination 
of three detectors (JV pa ir = 3), the above SNR can be 
reduced to Eq. (53) in Ref. [46[ except for the prefactor 
sin 2 x = 3/4 or (|B11[) in this paper. 

The expression (fT3"f is one of the most important re- 
sults of this paper. Provided the location and orienta- 
tion of GW detectors, the SNR is quantitatively eval- 
uated. Before doing so, it is important to note that a 
separate detection of three polarization modes is possi- 
ble only when the quantity det F becomes non- vanishing. 
As we explain in detail below, this implies that the con- 
figuration of space-based detectors must satisfy both con- 
ditions: 

(i) The detectors have to be separated by at least the 

distance of a typical wavelength of the observed 
GWs, e.g., 3 x 10 5 km for a GW with frequency 
/ = 1Hz. 

(ii) Detector pairs are not geometrically degenerate, e.g., 

three detectors located at the vertices of a non- 
equilateral triangle. 
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If one of the two conditions fails, the SNR is expected to 
be significantly degraded. 

For intuitive explanation of the above two conditions, 
let us consider the three-detector (three correlation- 
signal) case [46| (This does not lose generality because 
one can verify that SNR with an arbitrary number 
of detectors can be reduced to weighted sum of SNR 
with three-detector subset.). In the case, the condition 
dct F ^ corresponds to det II ^ where 



n(/) 



7l2 7l2 7l2 

723 723 723 
TVS 
731 7 3 1 731 



The condition (i) comes from nondegeneracy of the com- 
ponents in a column of II, e.g. 7^ ^ 7^ 7^ 7^. As we 
will see explicitly in Sec. IIII1 for a closer detector pair 
(a — > 0), there is no difference in the overlap reduction 
functions for each polarization mode, since the spherical 
Bessel functions, j% and j'4 vanish. On the other hand, 
for a detector pair with a ~ 1 , j% and j'4 are of the same 
order as jo and result in differences between the over- 
lap reduction functions. The condition (ii) comes from 
nondegeneracy of the components in a row of II, e.g. 
7i2 7^ 723 7^ 731- This condition implies that a 11011- 
colinear configuration of three detectors is preferred. 



III. SENSITIVITY TO POLARIZATION MODES 

We are in a position to discuss how well one can sep- 
arately detect scalar, vector and tensor GWBs. In this 
section, we specifically consider the two setups of detec- 
tor configuration, and estimate the detectability for each 
polarization mode. First, we consider the four-cluster 
configuration with coplanar orbits (case I). This is the 
prototypical configuration proposed at an early phase of 
the conceptual design of DECIGO [27j . We then move 
to a discussion of two-cluster configuration, in which the 
orbits of two clusters are slightly inclined in relation to 
one another (case II). In the calculations below, the en- 
ergy spectrum of GWBs f2^,(/) is assumed to be a flat 
spectrum, i.e., =const. In computing SNR below, 
we do not consider the single-cluster correlation. This is 
because correlation signals from a single cluster are not 
sensitive enough to GWB at low frequencies, as discussed 
in Appendix [Al 



A. Case I: four clusters 

1. Configuration 

Let us consider the detector configuration consisting of 
four clusters shown in Fig. [4] Each cluster is inclined by 
60 degrees from the orbital plane in order to close the or- 
bit. The guiding center of each cluster, i.e., the center-of- 
mass of three spacecrafts, follows a circular orbit around 




FIG. 4: Case I — Four clusters, A, A', B, and C, sharing the 
coplanar orbit, whose radius is 1 AU. 



the Sun, with the radius R — 1 AU w 1.5 x 10 8 km 
and orbital period of one year. In the coordinate system 
(A", Y, Z) shown in Fig. 21 the position of the guiding 
center is given by 

X(t) = (Ro cos <j>(t), Ro sin <f>(t), 0) , 

where the phase of the orbit is 4>(t) = uj or h\tt = 27r(f/lyr) 
for the clusters A and A'. The phases of the clusters B 
and C are relatively shifted to (3 and —/3 from that of 
the clusters A and A', respectively. Thus, the distances 
between the clusters. D = |AX|, become £>ab(/?) = 
D A c(/3) = 2i? |sin(/3/2)| for the AB and AC link, and 
D BC (f3) = 2Rq\ sin^| for the BC link. 

In each cluster, the position of the spacecraft relative 
to the guiding center is given by 

*i(t) = R z [-4>(tj\B.Y[-0]B.z[4>{t)]2ifi, (15) 



Xj,0 = -7= X (COSCT,;, Shier.;, 0' 

V3 



(16) 



with 9 = 7r/3. The matrices Ry and Hz are the rotation 
matrices around Y and Z axes, respectively. The angle 
Ui represents the orientation angle of the bisector of two 
arms of each interferometer. Let the angle of the interfer- 
ometer 1 be <j\ = (To- The orientations of interferometer 
2 and 3 in a cluster are given by a% = <jq + 2ir/3 and 
CT 3 = °o + 47r/3, respectively. 

In the setup mentioned above, the angles /3 and <Jq are 
apparently regarded as the free parameters. However, in 
an optimal combination of detector signals, several exam- 
inations reveal that the resultant SNR is turns out to be 
insensitive to any choice of ctq. We thus set an = 0, and 
treat the separation angle /3 as the only free parameter. 
For simplicity of the calculation below, the separation of 
the detectors between different clusters is approximated 
as the distance between the guiding centers of each clus- 
ter. This treatment is validated as long as we are in- 
terested in the low-frequency GWs satisfying X g 3> L. 
Then, the detector configuration can become stationary, 
and no explicit time-dependence appears at the overlap 
reduction functions in Eq. (1131) . 
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2. Overlap reduction functions 

For each detector link of four-cluster configuration, the 
overlap reduction function given by Eq. (jlOp is reduced 
to a rather compact expression. For correlation signals 
of AB, AC, BC links, the overlap reduction functions are 
respectively written as 

J AB (f,P^A,cr B ;a AB ) = Yg 

Q M (aAB,P/2) cos[2(cta - a B )] 
-6f (a AB ,p/2) sin[2(a A - a B )] 
+Q$ r (a AB ,P/2) cos[2/3 - 2(a A + a B )] 



, (17) 



7Ac(f,P,VA,<rc;ai A c) = l AB (f, ~P-> a A, <*c\ ot AB ) , 



(18) 



1 

16 



and 

lBc(f,0,<rB,<rc;aBc) 

x Qf{a BC ,P) cos[2(a s - a c )] 
+6f (auc,j8) sin[2(<T fl - ere)] 
+6f (a BC ,/8) cos[2(a B + a c )] 



(19) 



Note that the overlap reduction function for AA' link 
becomes 7^4; = 1, because of the mirror symmetry. As 
for A'B and A'C links, the overlap reduction functions 
are identical to those for AB and AC links. Here, the 
function Qf 1 (a, f3) is defined by 



QfJa,p) = J M (a)U h2 (0) , 



Q%(a,P) 
Q§(a,P) 



Ma) \ 
J v (a) sin 4 /3 
Js(a) j 

-8j 2 (a) -.74(a) 
4j 2 (a) +4j 4 (a) ) sin 2 /3 
8j 2 (a) - 6j 4 (a) 

34(a) 
-4j 4 (a) 

6j 4 (a) 



Ui(P) 


= sin 4 £ + 


8cos 6 /3(l 


+ cos 2 /3) , 


(20) 


Ui{fi) 


= 2(l + cos 2 ^)(l + 


cos 2 /3 + 2 cos 4 /3) 


sin 2,5 , 










(21) 


Jt(ol) 


= jo(a) + 


5 ■ ^ 
yj2(a) + 


112 j4(a) ' 


(22) 


Jv(a) 


= jo (a) - 


5 • n 

n J2(a)- 


3 • ^ 

- 2gJ4(a) , 


(23) 


Js(a) 


= jo (a) - 


5 ■ / X 

yj2(a) + 


9 • ^ 
56 j4(a) ■ 


(24) 



The subscript M stands for the polarization mode, 
T,V,S. The angles a A , a B , and ac are the orienta- 
tion of the interferometer in the clusters A, B, and C, 
respectively. a A B, a A c, and asc imply the dimension- 
less frequency a defined in Eq. (fTTj) for AB, AC, and 
BC links. Note that from the expressions ([T7l) - (|19p . the 
overlap reduction functions are invariant under the trans- 
formation a — > a + nir/2 except for an overall sign. This 
is due to the quadrupole nature of GWs. 

In the four-cluster configuration, the detector separa- 
tion D is typically of the order of 1 AU. This means 
that the overlap reduction function starts to oscillate, 
and rapidly decay above the characteristic frequency, 
f c = c/(2D) ~ 10~ 3 Hz. Examples of the overlap re- 
duction function for each polarization mode are shown 
in Fig. [5j where the parameters of detector configuration 
are selected as a A = as = ac = 0, and the results for 
P = 30°, 90°, and 150° are plotted from top to bottom 
panels. At the frequency / ~ 0.1 Hz, the amplitudes of 
overlap reduction function are significantly dropped, but 
they show different oscillatory behaviors for each polar- 
ization mode. The latter property is essential for sep- 
arately detecting the scalar, vector and tensor GWBs. 
Note that the distance between BC link becomes identi- 
cal for top and bottom panels, and the overlap reduction 
functions for each polarization mode coincide with each 
other. 

In the present setup, the condition for separate detec- 
tion of each polarization mode can be understood more 
precisely from Eqs. p7|) - (fT9"|) . Consider the close de- 
tectors with a <C 1 and j3 < 1. The spherical Bcsscl 
functions are approximated as 



3n(a) 



a" 



(2n+l)!! 

Further, we obtain Ui(P) = 16 + C(/3 2 ) and U 2 (P) = 
32/3 + C(/3 3 ). Then, terms including j 2 and j 4 become 
negligible, and we have 



lAB 
1BC 



j (a)[l+O(p)]cos[2(a A -a B )] 
j (a)[l+O(p)]cos[2(a B -a c )] 



Clearly, the overlap reduction functions for all polariza- 
tion modes become degenerate, and reduce to an iden- 
tical form in the limit j3 — >• 0. Therefore, the j% and 
j 4 terms play a crucial role in breaking this degener- 
acy. These terms become comparable to the jo term 
only when a > 1, leading to the condition D > X g . 
Hence, widely separated detectors are essential for sepa- 
rately measuring each polarization mode of GWB. How- 
ever, this generally conflicts with the optimal detection 
of GWBs. The resultant sensitivity to each polarization 
mode is thus significantly reduced, as shown below. 



3. Results 

The optimal SNR for four-cluster configuration is cal- 
culated with, in total, 54 correlation signals (AA', AB, 
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FIG. 5: Overlap reduction functions of the correlation between interferometers in cluster A and B (left panels) and cluster B 
and C (right panels) in the case I. The orientations of the interferometers are selected as a a = ob = oc = 0. Solid (red), 
dotted (green), and dashed (blue) curves correspond to the tensor, vector, and scalar modes, respectively. 



AC, A'B, A'C, BC x9 links = 54). Setting the obser- 
vation time and detection threshold to T b s = 3 yr and 
SNR = 5, we estimate minimum detectable amplitude 
/igi! gw (^/igfigw for the scalar mode). 

In Fig. [6l the resultant amplitude is plotted as func- 
tion of angle /3. At j3 ~ 120°, the sensitivity degrades 
due to the symmetry of the detector configuration. In 
other words, the clusters, A, B, and C, are located at the 
apexes of an equilateral triangle, and some of the corre- 
lation signals are degenerated. As j3 approaches 0° and 
180°, the detector sensitivity reaches nearly maximum, 
because the clusters A and B (or C), and B and C are 
close to the colocated configuration. In practice, to keep 
a better angular resolution to point GW sources, two of 
four clusters have to be located far from the star-like clus- 
ters [1^,|4^|. Thus, the optimal choice of the parameter 



P may be around (3 ~ 60°, which gives the detectable 
amplitude for each polarization mode as 

h 2 n^ = 2.2 x ifr 14 , 
hln v gw = i.i x io- 14 , 

C^Of w = 1.9 x IO" 14 . 

These results are compared with the optimal detection 
of GWB without mode separation. For two clusters that 
are colocated and coaligned like clusters A and A', the 
sensitivity reaches /ip^gwlo = 7.1 x 10~ 17 . Thus, for a 
separate detection of polarization modes, the sensitivity 
to GWB is significantly degraded by more than two or- 
ders of magnitude. 
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FIG. 7: Case II — Two clusters, A and B, whose radius of 
the orbits is 1 AU. The orbital plane of the cluster B is tilted 
by the angle ijj. 



nally proposed by Ref. [5(| in order to detect a circularly 
polarized component of tensor GWB. In this setup, the 
orbital configuration of the one cluster is the same as 
cluster A in case I, while the orbital plane of the other 
cluster B is slightly tilted by the angle tp around the Y 
axis. The position of each spacecraft in cluster A is de- 
scribed by Eqs. (IT51) and (flB]) . with specific choice of the 
parameters, 9 = 7r/3, o\ = 0, 02 = 27r/3, and 03 = Air/3. 
The orbit of the guiding center of the cluster B, and the 
relative positions of the spacecrafts are respectively given 
by 

X B (t) = TL Y [-iP]X A (t) , 
x B (t) = B. Y [-il>]2 A (t) . 

Note that, seen at a certain moment t, the interclus- 
ter correlation signals (the overlap reductions) between 
cluster A and B are highly degenerate due to the geo- 
metrical degeneracy in the interferometer location (e.g. 

tIibi f 1aib2 + 7aib3)- So > the differences be- 
tween the overlap reduction functions are of the order 
of Oil? I D 2 ). However, the degeneracy can be broken 
by utilizing the orbital motion of the clusters. The ad- 
vantage of this configuration is that the distance between 
the clusters gradually changes with time, and the corre- 
lation signals measured at the different times can be re- 
garded as that of a different detector pair with different 
location and separation. As a result of closer detector 
separation, the sensitivity to each polarization mode can 
become even better compared to the four-cluster config- 
uration. 

As long as we consider the low-frequency GWs, 
the detector separation is approximately described by 
D(ip,4>) = 2i? |sin('0/2) cos0|. Since <j> assigns a time 
to an overlap reduction function, the inclination an- 
gle ip is the only free parameter. In what follows, in- 
stead of tp, we use the maximum separation of clusters, 
-Dmax = 2i?o| sin(V'/2)|, to characterize the results. 



B. Case II: two clusters 

1. Configuration 

For better measurement of each polarization of GWB, 
we consider an alternative setup shown in Fig. [7] origi- 



2. Overlap reduction function 

Compared to the case I, the analytical expressions of 
overlap reduction functions for two-cluster configuration 
become much more complicated, but can be obtained 
from Eq. (fT0|) . For a cross-correlation signal of AB links, 
the overlap reduction functions are 



7 (/)0,^»0"A,o-B;a) = Tg 



ef(a,<£,V) cos[2(o- A + ctb)] + Of (a, 0,i/O sin[2(<7 A + a B ) 
+6f (a, 0, V) cos[2(a A - a B )\ + Sf (a, </>, V) sin[2(<M - a B )\ 
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where 




el 
ef 



©I 
ef 




C/i, 2 (0)sin 4 £ 




-8ja - J4 

4i 2 + 4j 4 ) Fi,2(0)sin 2 
8J2 - 6 j 4 





= — 16\/3 sin?/; sin 



cos ' 



(25) 



(26) 



(27) 



= 97 - 90 cos 2 
= 1 + 3 cos 2 



9 cos 4 

6 ± 



ization modes. For small rp <C 1, Eqs. (|25|) - p7|) become 



> cos 



2 sin 20 cos 0(1 + 2 cos 2 



The functions, U\, U2, Jt, Jv, and Js, are defined in Eqs. 
(f20")) - (|24[) . and the dimensionless frequency a is defined by 
Eq. (fTTj) . The argument of the spherical Bessel functions 
and 01,2,3,4 are omitted in the above equations. Note also 
that the dimensionless quantity a depends on not only <p 
but also ip. 



The examples of the overlap reduction function for 
each polarization mode are shown in Fig. [8l where the 
parameters of the detector configuration are specifically 
chosen as a a = &b = and D max /L — 10 3 , and the 
results are shown for = 0° (top left), 60° (bottom left), 
87° (top right), and 120° (bottom right). The distance 
between clusters A and B becomes maximum at cf> = 0° 
and 180°, and is minimum at <f> = 90° and 270°. Com- 
pared to the four-cluster case, the amplitudes of overlap 
reductions functions at / ~ 0.1 Hz become even larger 
for each polarization mode. This implies that the sepa- 
rate detection of polarized GWBs is achievable with high 
SNR. 



As examined in the four-cluster configuration, we con- 
sider the condition for a separate detection of three polar- 





/ JO + or J2 - 



= 16 



Jo 



28-' 



1792 J 4 

37 - 

" 448-7 4 



S! Hi 



J4 



= 16v / 3'0 sm< / > 



/ JO + 5g j 2 - 448 J4 

jo - r&j 2 + 1^4 

V A 25 A 9 a 

\ JO - 5« J2 - 224 J4 



Thus, for a -C 1, the terms j 2 and j'4 become negligible, 
and the overlap reduction functions for all polarization 
modes are reduced to an identical form. Hence, jo ~ 
J2 ~ J4 is required for having the different oscillatory 
behaviors for overlap reduction function of scalar, vector, 
and tensor modes and leads to the same conclusion as 
that in case I configuration, D > X g for each pair of 
detectors. 



3. Results 

For two-cluster configuration, we have, in total, 9 cor- 
relation signals between clusters A and B. Combining 
these signals, the optimal SNR is computed taking ac- 
count of the time variation of the overlap reduction func- 
tions. In practice, the time integral in Eq. (fH|) is 
discretized as the sum of the finite time segment. We 
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FIG. 8: Overlap reduction functions of the correlation between interferometers in cluster A and B (AB link) in the case II. The 
orientations of the interferometers are selected as a a — ob = 0. The tilt of the orbit is fixed to D ma x/£ = 10 3 . Solid (red), 
dotted (green), and dashed (blue) curves correspond to the tensor, vector, and scalar modes, respectively. 
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FIG. 9: Detectable foof2 gw (£ftoOgw for the scalar mode) after 
the mode separation in the case II. 



creasing as the separation -D max increases. The best sen- 
sitivity is achieved at D mSiX /L ~ 1.4 x 10 3 , and the de- 
tectable amplitude for each polarization mode becomes 

hftSi^ = 1.3 x io- 15 , 
h 2 ^ w = 8.5 x nr 16 , 
dh%n s gw = 7.4 x icr 16 . 

Therefore, compared to the four-cluster configuration, 
the sensitivity to the separate detection of each polar- 
ization mode is greatly improved. Note, however, that 
the optimal sensitivity to GWBs themselves is rather 
degraded, compared with those when we do not con- 
sider the mode separation. This is because no colocated 
and coaligned cluster configuration are available in the 
present setup. 

IV. DISCUSSION 



checked that the results remain unchanged if the number 
of segments in one year is larger than twelve. 

In Fig. [9l minimum detectable amplitude /igf2 gw is 
plotted against the maximum separation, _D max /L, keep- 
ing T bs = 3yr, and SNR = 5. The detectable amplitude 
for each polarization mode first decreases and begins in- 



The previous section reveals that a separate detection 
of three polarization modes with high signal sensitivity 
needs a sophisticated setup for detector configuration, 
but we may achieve fl gw ~ 10 -15 . In this section, we 
briefly discuss how the results are changed for a different 
setup or situation. 
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FIG. 10: Detectable /lo^gw (£/iofi g w for the scalar mode) after 
the mode separation in the case I with the cutoff frequency. 
The detector separation is selected as /3 — 60° (solid curves) 
and P — 90° (dotted curves). 
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FIG. 11: Detectable /iof2 gw (£fto^gw for the scalar mode) after 
the mode separation in the case II with the cutoff frequency. 
The detector separation is selected as D ma x = 10 3 L (solid 
curves) and 10 4 L (dotted curves). 



First consider the influence of astrophysical fore- 
grounds, which was not taken into account when we es- 
timated the SNR. It is expected that the low-frequency 
side of the DECIGO could be dominated by the unre- 
solved GWs from the white-dwarf binaries. According 
to the estimation by Ref. [5l|, cosmological population 
of white-dwarf binaries produces a large GW signal at 
/ < 0.2Hz, and may act as a confusion noise. Thus, be- 
low the frequency / cu t = 0.2Hz, a definite detection of 
cosmological GWBs might not be possible. 

Here, in order to examine the significance of this ef- 
fect, we introduce the low- frequency cutoff in the fre- 
quency integral of Eq. (fT5|) . and estimate the SNR again. 
Based on this, the detectable amplitude of GWB is calcu- 
lated for four- and two-cluster configurations. In Figs.fTOl 
and [TTJ the dependence of the detectable energy density 
/igfigw on the cutoff frequency are shown for four-cluster 
case with j3 — 60° and 90°, and two-cluster setup with 
D ma */L = 10 3 and 10 4 , respectively. In both cases, the 
effect of low-frequency cutoff becomes significant as / cu t 
increases, but the results are not drastically changed at 
/cut S, 0-2Hz. This is rather consistent with the results by 
Ref. [2a]. Thus, even in the presence of confusion noise, 
the detectable /igf2 gw remains unchanged as long as the 
cutoff frequency is below 0.2 Hz. This conclusion may be 
rather natural because DECIGO has been designed to 
evade the low-frequency confusion noises. 

Next consider the alternative design of space inter- 
ferometer, i.e., BBO. As we mentioned in Sec. |H BBO 
plans to use a transponder type with the arm length, 
L = 5 x 10 4 km. This point is rather different from DE- 
CIGO, however, the noise curve and the detector configu- 
ration of BBO are almost the same as those of DECIGO. 
Thus, we naively expect that the results obtained in the 
previous section basically hold for the case of BBO. A 
subtle point is that low-frequency approximation of the 



detector response which we adopted throughout the anal- 
ysis might not be valid for GWs at frequencies / > 1Hz. 
Thus, a correct treatment without using low-frequency 
approximation is necessary for quantitative estimation of 
detectability. Nevertheless, quantitative difference would 
be certainly small, and the qualitative point of our results 
can be applied to the BBO case, because the noise curve 
of BBO coincides with that of DECIGO within 5 % of 
a factor at frequencies below 1 Hz [29[ and the SNR is 
almost determined by a signal below 1 Hz. 

V. SUMMARY 

In this paper, we discuss how well we can separately de- 
tect and measure the extra-polarization modes of a GWB 
in addition to the standard tensor- type GWB, i.e., scalar 
and vector GWBs, via the space-based interferometers. 
In addition to the tensor mode, scalar and vector-type 
GWBs may have been produced in the early stage of the 
Universe through various mechanisms including inflation, 
phase transition and reheating of the Universe, when the 
general relativity would not strictly hold. Thus, the de- 
tection and measurement of scalar and vector modes of 
GWBs is a direct probe of gravity, and can also yield 
information about the physics of the early universe. 

We have presented the formula for optimal SNR to sep- 
arately detect three polarization modes combining mul- 
tiple correlation signals. Based on this, we have con- 
sidered the two specific configurations for planned space 
interferometer, DECIGO, and estimated the ability to 
detect extra-polarization modes of GWB. For the four- 
cluster setup consisting of the four sets of spacecraft con- 
stellations with coplanar orbits, the detectable minimum 
amplitudes of GWB are degraded significantly for each 
polarization mode, and the detectable density somehow 
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reaches ti$l gw ~ 10~ 14 . This is in marked contrast to the 
standard analysis that only considers the tensor mode of 
GWB. To raise the sensitivity, we then considered the 
two-cluster setup, in which the orbits of two set of space- 
craft constellation are slightly misaligned. Thanks to 
the non-stationarity of detector configuration, the cross- 
correlation measured at different times can be regarded 
as an independent set of signals with different location 
and separation, and this helps to improve the detection 
sensitivity. As a result, the detectable density is found 
to be h,Qfl gw ~ 10~ 15 for tensor mode, and even better 
for scalar and vector modes. 



Currently, no definite theoretical bound on the ampli- 
tude of GWB exists below /i§f2 gw ~ 10 -6 , and thus it is 
rather difficult to predict how much amount of GWB is 
expected for each polarization mode. Nevertheless, con- 
straints from cosmic microwave background anisotropies 
imply that the tensor-type GWB generated during infla- 
tion is likely to be as small as /iQf2 gw ~ 10~ 16 at fre- 
quency / - 0.1-1 Hz [H HIQ]. Given that the cou- 
pling parameters of scalar and vector degrees of freedom 
to a background gravitational field are almost the same 
as that of the tensor, no significant amount of GWB is 
expected for scalar and vector polarizations. Therefore, 
with the setup examined in this paper, it might be hard 
to separately measure the three polarization modes of 
inflationary GWB, although the detector itself has an 
ability to detect such a small GWB. 

Nonetheless, this argument is based on an extrapola- 
tion from the extremely low- frequency observation by 16 
orders of magnitude, and there may still exist many win- 
dows to generate a large amplitude of inflationary GWB 
around frequency / ~ 0.1-1 Hz. Further, there are sev- 
eral viable scenarios that can produce a large amplitude 
of low- frequency GWB. An example is the GWB pro- 
duced by density fluctuation through cosmological phase 
transition and/or preheating. In this case, the energy 
density of scalar GWB might exceed that of the tensor 
mode, because scalar GW would be easily emitted by the 
monopole moment of the density fluctuation. The resul- 
tant spectrum of GWB may has a sharp peak with the 
amplitude of at most ^f2 gw ~ 10~ 7 0, EE ED, EE IE3 . 
Hence, even with a limited sensitivity, a search for ad- 
ditional polarization modes of GWB via space-based in- 
terferometer is indispensable for a cosmological test of 
gravity, and definitely yields an additional scientific ben- 
efit for probing the physics of the early universe. 
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Appendix A: Correlation signal in a cluster 

In this Appendix, we show that it is impossible to ob- 
tain a correlation signal sensitive to a GWB in a cluster, 
even if three interferometers in a cluster are used. 

Let us consider a correlation signal in a cluster of DE- 
CIGO like Fig. [TJ We denote three spacecrafts as SCI, 
SC2, and SC3, three interferometers in the cluster as 
IFOl, IF02, and IF03. The displacement noise of the 
optical link between i-th SC and j-th SC (the light is 
injected from i-th SC, reflected at the mirror near j-th 
SC, and finally returns to i-th SC.) is d%j and the shot 
noise at i-th SC is Q. The noise components in the signal 
obtained by each IFO are written as 



si = dn - di3 + Ci ■ 

52 = d 23 - d 2 i + (2 , 

53 = d 3 i - d 32 + C3 ■ 



(Al) 
(A2) 
(A3) 



The displacement noises, dij, can be considered to be 
symmetric with respect to the subscripts, because the 
cavity storage time of light, lOL/c ~ 0.03 sec, is shorter 
than the period of a GW that we are interested in, ~ 
1-10 sec. So, Eqs. ([AT]) - (|A"3j) can be written as 



si = d 12 - 


di 3 + 


Ci , (A4) 


s 2 = d 23 - 


di 2 + 


C2 , (A5) 


s 3 = d 13 - 


d 23 + 


Ca • (A6) 


We linearly combine Eqs. ( 


M - 


(|A6|) with arbitrary 


coefficients, and take the ensemble 


average of the corre- 


lation signal 






((si + c 2 s 2 + c 3 s 3 )(sx + 


c' 2 s 2 - 


hc 3 s 3 )) 


= (l-c 2 )(l-4)<(4)- 


Ki- 


C3)(i-4X4>) 


+(C2 - cs)(4 - 4X4,) 


+ (1- 


f C2C 2 + C 3 C' 3 )(( 2 ) . 



(A7) 

Here we assumed that (dyCfc) — 0, (dijdke) — for i 7^ j 
and k ^ £, and (CiCj) = for i ^ j, and wrote (C 2 ) = 
(CiCj) f° r i = 3- To obtain the correlation signal that is 
insensitive to the correlation noise, the coefficients should 
be chosen as 

(C 2 , 03,4,4) = ( c 2, -1 - C 2 , 1, 1) , 

where c 2 is arbitrary. Thus one of the combination signals 
in the correlation must be a symmetric combination, s\ + 
s 2 + S3 j regardless of another combination signal. 
Next, we define 

1 / 

S sym = — (Sl + S 2 + S3) , 

v3 

which is known as the symmetrized Sagnac signal [56 
HH, and calculate its GW signal. As we will see below, 
the correlation signal with s sym is not helpful for the 
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separation of the multiple polarization modes. Using Eq. 
@, we can find the GW signal of s sym 



l sym 



1 

71 



(hi + h 2 + h 3 ) 



xh p (f,n)e 2 ^ t T> sym :e p (n), 

where D sym at the zeroth order in the low frequency ap- 
proximation is exactly zero since all terms are canceled 
due to the symmetry of the combination. To obtain the 
leading contribution, one needs to include the response 
functions in the detector arms in Eq. ^ (5(| [53, [H- 
lolj |. The detector tensor of the combination signal s sym 
is D sym (/, fi) oc ifL/c, then the GW response is sup- 
pressed below the frequency, / « c/L w 300 Hz. Con- 
sequently, at 0.1 — 1 Hz, the GW response is 300 — 3000 
times worse than that before taking the signal combina- 
tion. 



Appendix B: Derivation of optimal SNR formula for 
separately detecting scalar, vector and tensor 
polarizations 

Here, we will derive the SNR formula for separately 
detecting the three polarization modes by optimally com- 
bining arbitrary number of detector signals (N pa i T > 3). 

When one correlates detector signals in a frequency 
bin, the estimated value of the correlation signal, 
fluctuates around the true value, f^i(f)- Assuming the 
width of a frequency bin is much larger than the fre- 
quency resolution of the data we obtain, the likelihood 
function for jli(f) is expected to be Gaussian distribu- 
tion, owing to the central limit theorem. Let us denote a 
set of the estimated correlation signals of a detector pair 
in a frequency bin, {/ii(/);l < i < A pa i r }, where the 
subscript i designates a detector pair (for I-th and J-th 
detector pair, i = I J). The multidimensional likelihood 
function for the set of the estimator is written as 



£[{£*(/)}] « ex P 



N„ 



E 



{ikU)-MY 



, (Bl) 



where the covariance noise matrix, A/i(/), is defined as, 
say, M\ 2 {f) = Pi(f)P2(f)- Note that we assume that 
detector noise is not correlated with other detectors and 
that a GW signal is much smaller than the noise, so the 
calculation in Eq. [15] is applied here. 

On the other hand, from Eq. ([8]), the GW contribution 
in the correlation signal is 

/*(/) « 7f(/)^gw(/)+7f(/)C(/)+7f(/)^(/), 

(B2) 

A<(/) * 7f(/)^gw(/)+7f(/)^w(/)+7f(/)^(/). 

(B3) 



The hat fixed to f2 gw represents that it is the estimated 
quantity. Substituting Eqs. (|B2]| and flB3J} for Eq. (|BT]) , 
we obtain the quadratic with respect to ri gw in the argu- 
ment of Eq. (|B1|) . from which we can read the propor- 
tional relation of the Fisher matrix 



F(/) = a factor 



Ftt Ftv Fts 

Ftv Fyy Fys 

Fts Fvs Fss 



with 



Ftt{J) 
Fss(f) 
Fvs(f) 



T\2 



Ml! 



Fvv(f) = £ 



(7 



V\2 



(B4) 



E 

i 

E 



F TS (f) = Yl 



Til, 



(B6) 



Thus, we find that the SNR in a frequency bin is pro- 
portional to some combination of the components of the 
Fisher matrix, namely 



[SNR T (/)] 2 ex 
[SNR y (/)] 2 ex 



[SNR s (/)] : 



oc 



(^w) 2 
(F^ll 

(F-l)a2 

m 

(F-i) 



fc) 2 detF 



FvvFss 



F 2 



(^J 2 detF 
F 2 



S \2 



Ftt Fss 
(fif w ) 2 detF 



:i:S 



Ftt Fyy 



F 2 

r TV 



(B7) 
(B8) 
(B9) 



To determine the frequency-dependent factor of the 
proportional relation, we compare those with the SNR 
formula for -/V pa i r = 3 case with three detectors, which 
has been derived in For A pair = 3, Eqs. JB7J - (|B9|) 
are reduced to 



(SNR JW (/)) 2 ex 



H 2 (f) 
H 2 (f) 



M 



M =T,V,S 



(B10) 



n(/) 



7l2 7l2 7l2 
TVS 

723 723 723 
TVS 
131 731 731 
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T 






(^ w ) 2 (detn) 2 






H 2 (f)_ 




AP 2 (7 2 V 37 3 S i 


-llllll) 2 - 


^2P3(73 7 i7f 2 -7 3 S i7i y 2 ) 2 - 




" 7f 2 7 2 y 3 ) 2 


H 2 g {f) 


V 






(^ w ) 2 (detn) 2 






Hl(f)_ 






-7M) 2 - 


hP 2 P3(73 S i7r 2 -73 T i7f 2 ) 2 - 


hP 3 Pi(7f 2 7 2 T 3 




H 2 g (f)~ 


S 






(£Qf w ) 2 (detII) 2 






HIU) 






-7 2 y 3 7 3 T i) 2 - 


^2P3(73 T i7r 2 -7 3 7 i7 1 T 2 ) 2 - 


hP 3 Pi(7?27 2 y 3 





r 



On the other hand, according to [46|, the SNR formula 
in AT palr = 3 case (A factor coming from non-orthogonal 
arms, sinx 2 = 3/4, is corrected.) is given by 



df 



H 2 (f) 



PH 2 (f) 



1/2 



(Bll) 



Comparing Eq. (|B10|) with Eq. (jBllI) and compen- 
sating the proportional factor, and then integrating with 
respect to frequency, we finally obtain 



SNR 



M 



40tt 2V obs 



df 



(^j(/)) 2 detF(/) 

PF M {f) 



1/2 



(B12) 



where we redefined the Fisher matrix, F, as the matrix 

Ftt Ftv Fts 
= ( Ftv Fw Fvs 
Fts Fys Pss 



space-based detector though its orbital motion. It is easy 
to extend to time-dependent overlap reduction function. 
In Eq. (|B12|) . the overlap reduction functions are in- 
cluded through Eqs. (|B4[) - (|B6I) . As long as a stochastic 
GWB is stationary, the summation with respect to i is 
equivalent to the integral with respect to time, because 
the correlation signals at different times can be regarded 
as those of the detector pairs which have different lo- 
cation and orientation. Therefore, Eq. (|B12I) and Eqs. 
(|B4|) - (|B6]) should be replaced with 



SNR 



M 



and 



2 r 



9HI 
40tt 2 



df 



(^(/)) 2 detF(/) 
PF M (f) 



1/2 



(B13) 



The quantity J~m is the determinant of the sub-matrix, 
which is constructed by removing the M's elements from 
(new) F. 

Although so far we implicitly assume that the overlap 
reduction functions are time- independent, the overlap re- 
duction functions actually depend on time in the case of a 



iW(/) = E 



To *» dt lf{t,f)lf{t,f) 



where M and M' denote polarization modes, M, M 1 
T, V, S. 
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